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Support  experimental  and  computational  modeling  work  in: 


1.  Understanding  cognitive  processes  underlying  human  performance  in 
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2.  Achieving  robust  and  seamless  symbiosis  between  humans  and  systems 
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3.  Creating  machine  intelligent  systems  that  exhibit  human-level 
performance  in  uncertain  and  dynamic  environments. 
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Program  Roadmap 


Natural  or  artificial  intelligence  as  computational  learning 
algorithms  requiring  multi-disciplinary  approaches 


Mind  as  computational 
learning  algorithm  (software) 
running  on  the  brain 
(hardware) 


General  purpose  algorithms  that  the  brain  uses 
to  achieve  adaptive  intelligent  computation. 


QComputatjonaT 


a 


Neural 


Cognitive  science:  Identify  the  mind’s  invariants  from 
behavioral  experiments. 

Computer  science:  Develop  computational  algorithms 

(i.e.,  software)  implementable  in  artificial  systems. 

Neuroscience:  Offer  insights  into  how  the  brain  implements 
natural  intelligence  on  its  neural  hardware. 
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Program  Trends 


Neurocomputational  Cognition  /> 

Bio-inspired  Computing  Machines  / 

Robust  Decision  Making  and  Classification  * 

Memory,  Categorization,  and  Reasoning 
Belief  and  Preference  in  Decision  Making  under  Uncertainty 
Human-System  Interface 
Computational  Intelligence 
Meta-modeling 

Optimal  Learning  and  Planning  ^4 
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1.  Mathematical  and  Computational  Cognition 


Goal: 

Advance  the  computational  modeling  of  human  cognition  in  attention, 
memory,  categorization,  reasoning,  and  decision  making. 


Challenges  and  Strategy: 

•  Seek  algorithms  for  adaptive  intelligence  inspired  by  neuroscience 

•  Multidisciplinary  efforts  cutting  across  mathematics,  cognitive  science, 
neuroscience,  computer  science,  and  electrical  engineering. 


Aurel  Lazar 


Neurocognitive  Information  Processing 

A.  Lazar  (Columbia,  EECS) 


Neuronal  Information  Processing 

(Hodgkin  &  Huxley,  1963,  Nobel  Prize) 


“Cognition  is  a  kind  of  Neural  Computation.” 

JUJUJUU 

jjmiu 


Bactrim  iigiraJ 
fram  brain 
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Neurocognitive  Information  Processing 

A.  Lazar  (Columbia,  EECS) 


Scientific  Challenge:  The  Holy  Grail  of  Neuroscience 

-  How  does  the  brain  work? 

-  Can  we  “identify”  the  underlying  neural  circuit  computations  from 
neural  and  behavioral  data? 

-  Reverse  engineering  problem  (i.e.,  system  identification) 


(Behavioral  data) 


(To-be-identified) 


(Neural  data) 
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Neurocognitive  Information  Processing 

A.  Lazar  (Columbia,  EECS) 


Objective:  Develop  a  formal  methodology  for 
identifying  sensory  neural  circuits  of  the  fruit  fly 
brain. 

Technical  approach:  Dynamic  signal  processing 
systems;  convex  optimization;  parallel  computing; 
frame  theory. 

DoD  benefits:  Next-generation  brain-inspired 
information  processing  machines. 


Canonical  Neural  Encoding  Circuit  Model 


[Filter]-[ldeal  IAF]  Neural  Circuit  Model 


Single  Input  -  Single  Output  (SISO) 


For  future  AF:  Implementation  of 
computational  algorithms  extracted  from 
reverse  engineering  of  insect  flight  control 
systems  for  designing  nano  air  vehicles. 
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Objective:  Uncover  fundamental  biophysical  mechanisms 
of  single  neuronal  information  processing. 

Technical  approach:  Develop  memristor  models  of 
neuronal  synapses  and  ion  channels  based  on  nonlinear 
dynamics  theory. 

DoD  benefits:  If  successful,  could  radically  change  the 
notion  of  brain-inspired  computation.  Can  potentially 
produce  much  more  powerful  neuromorphic  chips  than 
current  state  of  the  art. 


L.  Chua 


Memristive  Hodgkin-Huxley  Model 


Theorem:  Sub-Critical  Hopf 
Bifurcation  and  Edge  of  Chaos 


The  Sub-Critical  Hopf  Bifurcation 
responsible  for  the  Action  Potential 
occurs  exactly  on  the  right  boundary  of 
the  neuron’s  edge  of  chaos. 


I  Neurons  ore  poised  near  the  Edge  of  Chaos,  whose  \ 
|  innate  dynamics  are  invicible  ( like  the  B2),  until , 
I  triggered  to  generate  action  potential  ( spikes ) 


Edge 

of 

Chaos 
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2.  Robust  Decision  Making 
in  Human-System  Interface 


Goal: 

Advance  the  research  on  mixed  human-machine  systems  to  aid  inference, 
communication,  prediction,  planning,  scheduling,  and  decision  making. 


Challenges  and  Strategy: 

•  Seek  computational  principles  for  optimal  symbiosis  of  mixed  human- 
machine  systems  in  data-to-decision  problems. 

•  Machine  learning  methods  for  robust  reasoning  and  planning. 


Objective:  Explore  and  characterize  the 
representation  and  mechanisms  of  spatial  cognition 
in  human-system  interfaces. 

Technical  approach:  Empirical  studies  of  human 
performance  on  lab  and  naturalistic  tasks. 

DoD  benefits:  Improved  understanding  of  human 
spatial  information  processing  abilities,  thereby 
informing  decision  making  regarding  training  and 
workload  assessment. 


Air  Force  operations:  Highly 
complex  and  fundamentally  spatial 


Human-system  interface  in  UAVs  Framework  for  spatial  cognition 


Central  Cognitive  Processing 
Memory 

[semantic  H  Episodic  [<-| 


mulus. 


Cue  Usefulness  by  Presentation  Time  & 

Distal  Order/Practice 

Only  ■  Long  Stimulus  Duration  (399ms) 

Short  Stimulus  Duraction  (53ms) 


DISTRIBUTION  STATEMENT  A  -  Unclassified,  Unlimited  Distribution 


11 


Objective:  Develop  “calculus  of  risk”  that 
enables  autonomous  systems  to  operate  within 
specified  risk  bounds. 

Technical  approach:  Planning  algorithms  that 
reason  about  risk  and  generate  course  of  action 
to  take  while  satisfying  constraints  on  failure. 

DoD  benefits:  Highly  trustworthy  autonomous 
systems  with  increased  probability  of  mission 
success  and  reduced  probability  of  catastrophic 
failure,  such  as  UAV  loss. 


B.  Williams 


Drivers  for  Autonomous  Decision  Making 


Data  Analysis  and  Logistic  support 


Adaptive  Sampling 

but  autonomy  incurs  risk 


Input:  Probabilistic  Temporal  Plan  Network 


Demonstration:  Robot  Air  Taxi  Driver 


Personal  Transportation  System 


gjf 

ft 

Goals 

1.  Negotiation 

2.  Mission 
Planning 

3.  Risk- 
sensitive 
Navigation 

Actions 
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3.  Computational  and  Machine  Intelligence 


Goal: 

Advance  the  research  on  machine  intelligence  architectures  that  derive  from 
cognitive  and  biological  models  of  human  intelligence. 


Challenges  and  Strategy: 

•  Seek  fundamental  computational  principles  for  creating  autonomous 
systems  that  learn  and  function  at  the  level  of  flexibility  comparable  to  that  of 
humans. 
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Bio-inspired  Computation 

J.  Wiles  (U.  Queensland,  ITEE) 


Objective:  Develop  bio-inspired  algorithms  that 
are  clock-free,  grid-free,  scale-free,  and  symbol- 
free. 

Technical  approach:  Develop  and  test  neural 
systems  inspired  by  hippocampal  architectures. 

DoD  benefits:  Fundamental  discoveries  into 
computation  in  natural  systems  could  lead  to  the 
development  of  robust  and  scalable  machines. 


J.  Wiles 


Bio-inspired  computation 

Summary:  Rethinking  the  role  of  time  in  processing 


Clock-free:  spiking  neuron  as  an 
asynchronous  micro-pipeline 

Grid-free:  topological  graphs  with 
local  metric  structure  and 
global  regularization 

Scale-free  and  symbol-free: 
multi-scale  recurrent  networks 


Clock-free 

Coordination  without  global  clocks 


Neural  networks  with  different  inhibitory  neuron  classes  can  create  an 
asynchronous  temporal  pipeline  in  excitatory  neurons 


Grid-free:  Simultaneous  iRAT:  Neurorobotic  testbed 

localization  and  mapping 


Clock-free  systems 

•  Fully  asynchronous 

•  Every  signal  sends  state 
information 

•  Scalable  to  any  size 
circuit 

•  Require  duplicate 
hardware  and  more 
complex  circuits 

•  Can  run  at  maximum 
speed  when  needed  (no 
oscillations  required) 

•  Can  give  rise  to  rhythms 
and  mixtures  of  rhythms 
through  emergent 
processes 


Defined  types  of  cortical  intemeurons 
structure  space  and  spike  timing 
(Fig.  Somogyi  and  Klausberger,  2005) 


Smith,  DeMar,  Yuan, 
Hagedom  and  Ferguson, 
(2001 )  Delay-insensitive  gate- 
level  pipelining,  Integration, 
the  VLSI  Journal,  30(2):  103- 
131 


Control  points 


Data 

Control 

Reset 

Input- 

ready 


Output- 

ready 


Overhead  view  of 
environment 


OpenRatSLAM  map 


"  & 


iRat 

(intelligent  rat  animat 
technology) 

PC  on  wheels 

Size  is  the  key  challenge 
for  the  design  of  a  robot 
that  interacts  with  a  rat 
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Robust  Intelligence  in  Complex  Problem  Solving 

L.  Kaelbling  (MIT,  EECS) 


Objective:  Develop  algorithms  that  allow 
autonomous  agents  to  perform  long-duration 
tasks  in  complex  and  uncertain  environments. 

Technical  approach:  Formal  A.I.  methods  for 
integrating  logical  and  probabilistic  reasoning. 

L.  Kaelbling 

DoD  benefits:  Robust  and  effective  battle  space 
planning,  coordination,  and  surveillance  in  long- 
horizon,  large-space,  and  uncertain  domains. 


Laboratory  testbed 


POMDP:  Optimal  solution  is  complex... 


Contents  of  most  of 
space  not  known 


Object  not  in  initial 
model 


Substantial  uncertainty 
about  poses  of  known 
objects 
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ONR  (Paul  Bello) 

*  Perception,  Metacognition,  and  Cognitive  Control  Program 
ONR  (Tom  McKenna) 

*  Computational  Neuroscience  Program 
ARO  (Janet  Spoonamore) 

*  Decision  and  Neurosciences  Program 
NSF  (Betty  Tuller  &  Lawrence  Gottlob) 

*  Perception,  Action,  and  Cognition  Program 
DARPA  (Gill  Pratt) 

*  Systems  of  Neuromorphic  Adaptive  Plastic  Scalable 
Electronics  (SyNAPSE)  Program 

IARPA  (Brad  Minnery) 

*  Integrated  Cognitive-Neuroscience  Architectures  for 
Understanding  Sensemaking  (ICArUS)  Program 
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Transition 


NICTA  (Australia)  team: 

-  Project  on  large-scale  lifelong-learning  optimization 

-  Recent  visits  by  NICTA  team  to  Air  Mobility  Command  and  US 

Transportation  Command  T.  Walsh 

-  Access  of  real-world  data:  Huge  benefits  to  model  development 

-  Transition  opportunities  of  basic  research  to  help  manage  complex  military 
logistics  processes 


Recent  Highlights 


Korean  Brain  Science  Initiative: 

-  AOARD  initiative  (PO:  LtCol  Brian  Sells) 

-  Visit  by  AFOSR  representatives  to  five 
Korean  universities  June  2012 

-  Four  projects  at  SNU  and  KAIST  co-funded 
with  AOARD 


From  Neural  Populations  to 
Hypernetworks 


PI:  Byoung-Tak  Zhang  (Seoul  National  University) 


DARPA  SyNAPSE  Program: 

-  Design,  fabrication,  and  demonstration  of 
neuromorphic  chips  in  real-world  problems 

-  Ultra-low  power  consumption  for  ultra-high 
processing  capacity 

-  Visit  to  IBM  and  HRL  teams  Oct  2012 

-  Intersection  with  Air  Force  Research  Lab 
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Questions? 


Thank  you  for  your  attention 


Jay  Myung,  Program  Officer,  AFOSR/RTC 

Jav.mvung@afosr.af.mil 

(703)  696-8478 
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